Skip to content

Update smoke test latest tool versions#10924

Open
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260322
Open

Update smoke test latest tool versions#10924
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260322

Conversation

@dd-octo-sts
Copy link
Contributor

@dd-octo-sts dd-octo-sts bot commented Mar 22, 2026

What Does This Do

This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:

  • Gradle: 9.4.1
  • Maven: 3.9.14
  • Maven Surefire: 3.5.5

Motivation

Keep smoke tests running against the latest stable versions of build tools.

Contributor Checklist

  • Verify smoke tests pass with the new versions

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner March 22, 2026 05:29
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Mar 22, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 22, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260322
git_commit_date 1774050014 1774157911
git_commit_sha c00f676 9de7e5bb64
release_version 1.61.0-SNAPSHOT~c00f676bb9 1.61.0-SNAPSHOT~79de7e5bb64
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774159203 1774159203
ci_job_id 1528568685 1528568685
ci_pipeline_id 103889641 103889641
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-fs097erx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-fs097erx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059567
Total [baseline] (11.055 s) : 0, 11054803
Agent [candidate] (1.059 s) : 0, 1059098
Total [candidate] (11.053 s) : 0, 11052968
section appsec
Agent [baseline] (1.247 s) : 0, 1247359
Total [baseline] (11.191 s) : 0, 11190957
Agent [candidate] (1.251 s) : 0, 1250793
Total [candidate] (11.092 s) : 0, 11091804
section iast
Agent [baseline] (1.229 s) : 0, 1229327
Total [baseline] (11.256 s) : 0, 11256122
Agent [candidate] (1.231 s) : 0, 1230610
Total [candidate] (11.342 s) : 0, 11341900
section profiling
Agent [baseline] (1.193 s) : 0, 1192723
Total [baseline] (10.999 s) : 0, 10999495
Agent [candidate] (1.185 s) : 0, 1185177
Total [candidate] (10.971 s) : 0, 10970719
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.247 s 187.792 ms (17.7%)
Agent iast 1.229 s 169.761 ms (16.0%)
Agent profiling 1.193 s 133.156 ms (12.6%)
Total tracing 11.055 s -
Total appsec 11.191 s 136.154 ms (1.2%)
Total iast 11.256 s 201.319 ms (1.8%)
Total profiling 10.999 s -55.308 ms (-0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.251 s 191.695 ms (18.1%)
Agent iast 1.231 s 171.512 ms (16.2%)
Agent profiling 1.185 s 126.079 ms (11.9%)
Total tracing 11.053 s -
Total appsec 11.092 s 38.835 ms (0.4%)
Total iast 11.342 s 288.932 ms (2.6%)
Total profiling 10.971 s -82.25 ms (-0.7%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (631.194 ms) : 0, 631194
BytebuddyAgent [candidate] (630.906 ms) : 0, 630906
AgentMeter [baseline] (29.475 ms) : 0, 29475
AgentMeter [candidate] (29.331 ms) : 0, 29331
GlobalTracer [baseline] (257.258 ms) : 0, 257258
GlobalTracer [candidate] (256.715 ms) : 0, 256715
AppSec [baseline] (31.692 ms) : 0, 31692
AppSec [candidate] (31.592 ms) : 0, 31592
Debugger [baseline] (60.543 ms) : 0, 60543
Debugger [candidate] (60.318 ms) : 0, 60318
Remote Config [baseline] (610.848 µs) : 0, 611
Remote Config [candidate] (592.628 µs) : 0, 593
Telemetry [baseline] (8.015 ms) : 0, 8015
Telemetry [candidate] (7.998 ms) : 0, 7998
Flare Poller [baseline] (3.504 ms) : 0, 3504
Flare Poller [candidate] (4.285 ms) : 0, 4285
section appsec
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (657.888 ms) : 0, 657888
BytebuddyAgent [candidate] (661.051 ms) : 0, 661051
AgentMeter [baseline] (12.163 ms) : 0, 12163
AgentMeter [candidate] (12.14 ms) : 0, 12140
GlobalTracer [baseline] (258.392 ms) : 0, 258392
GlobalTracer [candidate] (258.606 ms) : 0, 258606
IAST [baseline] (24.277 ms) : 0, 24277
IAST [candidate] (24.252 ms) : 0, 24252
AppSec [baseline] (178.096 ms) : 0, 178096
AppSec [candidate] (177.983 ms) : 0, 177983
Debugger [baseline] (66.302 ms) : 0, 66302
Debugger [candidate] (66.483 ms) : 0, 66483
Remote Config [baseline] (628.658 µs) : 0, 629
Remote Config [candidate] (624.75 µs) : 0, 625
Telemetry [baseline] (8.349 ms) : 0, 8349
Telemetry [candidate] (8.43 ms) : 0, 8430
Flare Poller [baseline] (3.656 ms) : 0, 3656
Flare Poller [candidate] (3.644 ms) : 0, 3644
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (796.711 ms) : 0, 796711
BytebuddyAgent [candidate] (798.669 ms) : 0, 798669
AgentMeter [baseline] (11.475 ms) : 0, 11475
AgentMeter [candidate] (11.455 ms) : 0, 11455
GlobalTracer [baseline] (247.67 ms) : 0, 247670
GlobalTracer [candidate] (247.866 ms) : 0, 247866
IAST [baseline] (25.47 ms) : 0, 25470
IAST [candidate] (25.34 ms) : 0, 25340
AppSec [baseline] (26.666 ms) : 0, 26666
AppSec [candidate] (26.483 ms) : 0, 26483
Debugger [baseline] (70.854 ms) : 0, 70854
Debugger [candidate] (69.728 ms) : 0, 69728
Remote Config [baseline] (530.306 µs) : 0, 530
Remote Config [candidate] (526.641 µs) : 0, 527
Telemetry [baseline] (9.256 ms) : 0, 9256
Telemetry [candidate] (9.668 ms) : 0, 9668
Flare Poller [baseline] (3.397 ms) : 0, 3397
Flare Poller [candidate] (3.497 ms) : 0, 3497
section profiling
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (689.172 ms) : 0, 689172
BytebuddyAgent [candidate] (683.943 ms) : 0, 683943
AgentMeter [baseline] (9.073 ms) : 0, 9073
AgentMeter [candidate] (9.067 ms) : 0, 9067
GlobalTracer [baseline] (217.372 ms) : 0, 217372
GlobalTracer [candidate] (215.958 ms) : 0, 215958
AppSec [baseline] (32.479 ms) : 0, 32479
AppSec [candidate] (32.126 ms) : 0, 32126
Debugger [baseline] (66.268 ms) : 0, 66268
Debugger [candidate] (66.154 ms) : 0, 66154
Remote Config [baseline] (561.962 µs) : 0, 562
Remote Config [candidate] (553.144 µs) : 0, 553
Telemetry [baseline] (7.726 ms) : 0, 7726
Telemetry [candidate] (7.675 ms) : 0, 7675
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (3.451 ms) : 0, 3451
ProfilingAgent [baseline] (93.992 ms) : 0, 93992
ProfilingAgent [candidate] (93.997 ms) : 0, 93997
Profiling [baseline] (94.553 ms) : 0, 94553
Profiling [candidate] (94.563 ms) : 0, 94563
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055007
Total [baseline] (8.877 s) : 0, 8876949
Agent [candidate] (1.064 s) : 0, 1063698
Total [candidate] (8.843 s) : 0, 8842509
section iast
Agent [baseline] (1.247 s) : 0, 1247270
Total [baseline] (9.582 s) : 0, 9581963
Agent [candidate] (1.227 s) : 0, 1226688
Total [candidate] (9.576 s) : 0, 9575844
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.247 s 192.263 ms (18.2%)
Total tracing 8.877 s -
Total iast 9.582 s 705.014 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.227 s 162.99 ms (15.3%)
Total tracing 8.843 s -
Total iast 9.576 s 733.335 ms (8.3%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (627.822 ms) : 0, 627822
BytebuddyAgent [candidate] (633.812 ms) : 0, 633812
AgentMeter [baseline] (29.339 ms) : 0, 29339
AgentMeter [candidate] (29.645 ms) : 0, 29645
GlobalTracer [baseline] (256.552 ms) : 0, 256552
GlobalTracer [candidate] (258.511 ms) : 0, 258511
AppSec [baseline] (31.605 ms) : 0, 31605
AppSec [candidate] (31.966 ms) : 0, 31966
Debugger [baseline] (59.59 ms) : 0, 59590
Debugger [candidate] (59.997 ms) : 0, 59997
Remote Config [baseline] (588.472 µs) : 0, 588
Remote Config [candidate] (605.711 µs) : 0, 606
Telemetry [baseline] (8.703 ms) : 0, 8703
Telemetry [candidate] (8.05 ms) : 0, 8050
Flare Poller [baseline] (3.485 ms) : 0, 3485
Flare Poller [candidate] (3.572 ms) : 0, 3572
section iast
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (810.318 ms) : 0, 810318
BytebuddyAgent [candidate] (795.687 ms) : 0, 795687
AgentMeter [baseline] (12.018 ms) : 0, 12018
AgentMeter [candidate] (11.426 ms) : 0, 11426
GlobalTracer [baseline] (250.611 ms) : 0, 250611
GlobalTracer [candidate] (247.788 ms) : 0, 247788
AppSec [baseline] (27.067 ms) : 0, 27067
AppSec [candidate] (27.42 ms) : 0, 27420
Debugger [baseline] (69.941 ms) : 0, 69941
Debugger [candidate] (68.018 ms) : 0, 68018
Remote Config [baseline] (534.221 µs) : 0, 534
Remote Config [candidate] (527.459 µs) : 0, 527
Telemetry [baseline] (9.754 ms) : 0, 9754
Telemetry [candidate] (9.668 ms) : 0, 9668
Flare Poller [baseline] (3.529 ms) : 0, 3529
Flare Poller [candidate] (3.469 ms) : 0, 3469
IAST [baseline] (25.865 ms) : 0, 25865
IAST [candidate] (25.428 ms) : 0, 25428
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260322
git_commit_date 1774050014 1774157913
git_commit_sha c00f676 9de7e5bb64
release_version 1.61.0-SNAPSHOT~c00f676bb9 1.61.0-SNAPSHOT~79de7e5bb64
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774159684 1774159684
ci_job_id 1528568687 1528568687
ci_pipeline_id 103889641 103889641
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1tupcw8v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1tupcw8v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-199.402µs; -70.622µs] or [-10.901%; -3.861%]
unstable
[-1251.682µs; -397.230µs] or [-21.424%; -6.799%]
unstable
[+18.002op/s; +490.498op/s] or [+0.954%; +25.986%]
1.694ms 5.018ms 2141.812op/s 1.829ms 5.842ms 1887.562op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.608ms; +2.801ms] or [+9.727%; +16.948%]
unstable
[+2.052ms; +5.548ms] or [+7.351%; +19.875%]
unstable
[-57.845op/s; -1.530op/s] or [-21.267%; -0.562%]
18.734ms 31.716ms 242.312op/s 16.529ms 27.916ms 272.000op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.15 ms) : 16980, 17320
.   : milestone, 17150,
appsec (19.033 ms) : 18845, 19220
.   : milestone, 19033,
code_origins (17.959 ms) : 17778, 18139
.   : milestone, 17959,
iast (17.655 ms) : 17481, 17830
.   : milestone, 17655,
profiling (19.581 ms) : 19381, 19780
.   : milestone, 19581,
tracing (17.624 ms) : 17449, 17799
.   : milestone, 17624,
section candidate
no_agent (19.262 ms) : 19062, 19463
.   : milestone, 19262,
appsec (18.639 ms) : 18449, 18830
.   : milestone, 18639,
code_origins (17.575 ms) : 17397, 17754
.   : milestone, 17575,
iast (17.731 ms) : 17557, 17906
.   : milestone, 17731,
profiling (19.762 ms) : 19559, 19964
.   : milestone, 19762,
tracing (17.493 ms) : 17319, 17668
.   : milestone, 17493,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.15 ms [16.98 ms, 17.32 ms] -
appsec 19.033 ms [18.845 ms, 19.22 ms] 1.883 ms (11.0%)
code_origins 17.959 ms [17.778 ms, 18.139 ms] 808.63 µs (4.7%)
iast 17.655 ms [17.481 ms, 17.83 ms] 505.375 µs (2.9%)
profiling 19.581 ms [19.381 ms, 19.78 ms] 2.43 ms (14.2%)
tracing 17.624 ms [17.449 ms, 17.799 ms] 473.841 µs (2.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.262 ms [19.062 ms, 19.463 ms] -
appsec 18.639 ms [18.449 ms, 18.83 ms] -623.383 µs (-3.2%)
code_origins 17.575 ms [17.397 ms, 17.754 ms] -1.687 ms (-8.8%)
iast 17.731 ms [17.557 ms, 17.906 ms] -1.531 ms (-7.9%)
profiling 19.762 ms [19.559 ms, 19.964 ms] 499.066 µs (2.6%)
tracing 17.493 ms [17.319 ms, 17.668 ms] -1.769 ms (-9.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.185 ms) : 1174, 1197
.   : milestone, 1185,
iast (3.189 ms) : 3146, 3232
.   : milestone, 3189,
iast_FULL (5.826 ms) : 5767, 5885
.   : milestone, 5826,
iast_GLOBAL (3.517 ms) : 3460, 3574
.   : milestone, 3517,
profiling (2.406 ms) : 2381, 2430
.   : milestone, 2406,
tracing (1.8 ms) : 1785, 1815
.   : milestone, 1800,
section candidate
no_agent (1.188 ms) : 1176, 1199
.   : milestone, 1188,
iast (3.249 ms) : 3204, 3294
.   : milestone, 3249,
iast_FULL (5.806 ms) : 5747, 5866
.   : milestone, 5806,
iast_GLOBAL (3.499 ms) : 3443, 3554
.   : milestone, 3499,
profiling (2.111 ms) : 2091, 2132
.   : milestone, 2111,
tracing (1.771 ms) : 1756, 1786
.   : milestone, 1771,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.174 ms, 1.197 ms] -
iast 3.189 ms [3.146 ms, 3.232 ms] 2.004 ms (169.1%)
iast_FULL 5.826 ms [5.767 ms, 5.885 ms] 4.641 ms (391.5%)
iast_GLOBAL 3.517 ms [3.46 ms, 3.574 ms] 2.332 ms (196.7%)
profiling 2.406 ms [2.381 ms, 2.43 ms] 1.22 ms (103.0%)
tracing 1.8 ms [1.785 ms, 1.815 ms] 615.161 µs (51.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.199 ms] -
iast 3.249 ms [3.204 ms, 3.294 ms] 2.061 ms (173.6%)
iast_FULL 5.806 ms [5.747 ms, 5.866 ms] 4.619 ms (388.9%)
iast_GLOBAL 3.499 ms [3.443 ms, 3.554 ms] 2.311 ms (194.6%)
profiling 2.111 ms [2.091 ms, 2.132 ms] 923.825 µs (77.8%)
tracing 1.771 ms [1.756 ms, 1.786 ms] 583.198 µs (49.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260322
git_commit_date 1774050014 1774158058
git_commit_sha c00f676 9de7e5bb64
release_version 1.61.0-SNAPSHOT~c00f676bb9 1.61.0-SNAPSHOT~79de7e5bb64
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774159547 1774159547
ci_job_id 1528568689 1528568689
ci_pipeline_id 103889641 103889641
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-z9vrvchb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-z9vrvchb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.772 ms) : 3554, 3989
.   : milestone, 3772,
iast (2.266 ms) : 2196, 2335
.   : milestone, 2266,
iast_GLOBAL (2.304 ms) : 2234, 2374
.   : milestone, 2304,
profiling (2.087 ms) : 2032, 2142
.   : milestone, 2087,
tracing (2.06 ms) : 2007, 2114
.   : milestone, 2060,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.813 ms) : 3591, 4035
.   : milestone, 3813,
iast (2.269 ms) : 2199, 2338
.   : milestone, 2269,
iast_GLOBAL (2.304 ms) : 2235, 2374
.   : milestone, 2304,
profiling (2.112 ms) : 2055, 2169
.   : milestone, 2112,
tracing (2.069 ms) : 2016, 2123
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.772 ms [3.554 ms, 3.989 ms] 2.296 ms (155.6%)
iast 2.266 ms [2.196 ms, 2.335 ms] 789.982 µs (53.5%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.374 ms] 828.505 µs (56.1%)
profiling 2.087 ms [2.032 ms, 2.142 ms] 611.409 µs (41.4%)
tracing 2.06 ms [2.007 ms, 2.114 ms] 584.942 µs (39.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 3.813 ms [3.591 ms, 4.035 ms] 2.333 ms (157.7%)
iast 2.269 ms [2.199 ms, 2.338 ms] 788.828 µs (53.3%)
iast_GLOBAL 2.304 ms [2.235 ms, 2.374 ms] 824.574 µs (55.7%)
profiling 2.112 ms [2.055 ms, 2.169 ms] 632.2 µs (42.7%)
tracing 2.069 ms [2.016 ms, 2.123 ms] 589.646 µs (39.8%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.839 s) : 14839000, 14839000
.   : milestone, 14839000,
appsec (14.859 s) : 14859000, 14859000
.   : milestone, 14859000,
iast (18.088 s) : 18088000, 18088000
.   : milestone, 18088000,
iast_GLOBAL (18.051 s) : 18051000, 18051000
.   : milestone, 18051000,
profiling (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
tracing (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,
section candidate
no_agent (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
appsec (14.596 s) : 14596000, 14596000
.   : milestone, 14596000,
iast (18.295 s) : 18295000, 18295000
.   : milestone, 18295000,
iast_GLOBAL (17.852 s) : 17852000, 17852000
.   : milestone, 17852000,
profiling (15.056 s) : 15056000, 15056000
.   : milestone, 15056000,
tracing (14.89 s) : 14890000, 14890000
.   : milestone, 14890000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.839 s [14.839 s, 14.839 s] -
appsec 14.859 s [14.859 s, 14.859 s] 20.0 ms (0.1%)
iast 18.088 s [18.088 s, 18.088 s] 3.249 s (21.9%)
iast_GLOBAL 18.051 s [18.051 s, 18.051 s] 3.212 s (21.6%)
profiling 14.944 s [14.944 s, 14.944 s] 105.0 ms (0.7%)
tracing 14.75 s [14.75 s, 14.75 s] -89.0 ms (-0.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.898 s [14.898 s, 14.898 s] -
appsec 14.596 s [14.596 s, 14.596 s] -302.0 ms (-2.0%)
iast 18.295 s [18.295 s, 18.295 s] 3.397 s (22.8%)
iast_GLOBAL 17.852 s [17.852 s, 17.852 s] 2.954 s (19.8%)
profiling 15.056 s [15.056 s, 15.056 s] 158.0 ms (1.1%)
tracing 14.89 s [14.89 s, 14.89 s] -8.0 ms (-0.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants